<i>Learning to Fly</i>: A Distributed Deep Reinforcement Learning Framework for Software-Defined UAV Network Control
نویسندگان
چکیده
Control and performance optimization of wireless networks Unmanned Aerial Vehicles (UAVs) require scalable approaches that go beyond architectures based on centralized network controllers. At the same time, model-based is often limited by accuracy approximations relaxations necessary to solve UAV control problem through convex or similar techniques, channel models used. To address these challenges, this article introduces a new architectural framework optimize Deep Reinforcement Learning (DRL). Furthermore, it proposes virtualized, `ready-to-fly' emulation environment generate extensive data traces train DRL algorithms, which are notoriously hard collect battery-powered networks. The training integrates previously developed protocol stacks for UAVs into CORE/EMANE tool. Our virtual guarantees collection high-fidelity can be used agents. proposed architecture enables distributed data-driven (with up 3.7 × throughput improvement 0.2 latency reduction in reported experiments), facilitates reconfiguration, provides solution large
منابع مشابه
Neural Network Based Protection of Software Defined Network Controller against Distributed Denial of Service Attacks
Software Defined Network (SDN) is a new architecture for network management and its main concept is centralizing network management in the network control level that has an overview of the network and determines the forwarding rules for switches and routers (the data level). Although this centralized control is the main advantage of SDN, it is also a single point of failure. If this main contro...
متن کاملOvid: A Software-Defined Distributed Systems Framework
We present Ovid, a framework for building evolvable large-scale distributed systems that run in the cloud. Ovid constructs and deploys distributed systems as a collection of simple components, creating systems suited for containerization in the cloud. Ovid supports evolution of systems through transformations, which are automated refinements. Examples of transformations include replication, bat...
متن کاملA Deep-Reinforcement Learning Approach for Software-Defined Networking Routing Optimization
In this paper we design and evaluate a Deep-Reinforcement Learning agent that optimizes routing. Our agent adapts automatically to current traffic conditions and proposes tailored configurations that attempt to minimize the network delay. Experiments show very promising performance. Moreover, this approach provides important operational advantages with respect to traditional optimization algori...
متن کاملDeep Reinforcement Learning framework for Autonomous Driving
Reinforcement learning is considered to be a strong AI paradigm which can be used to teach machines through interaction with the environment and learning from their mistakes. Despite its perceived utility, it has not yet been successfully applied in automotive applications. Motivated by the successful demonstrations of learning of Atari games and Go by Google DeepMind, we propose a framework fo...
متن کاملA Multi-Objective Deep Reinforcement Learning Framework
This paper presents a new multi-objective deep reinforcement learning (MODRL) framework based on deep Q-networks. We propose linear and non-linear methods to develop the MODRL framework that includes both single-policy and multi-policy strategies. The experimental results on a deep sea treasure environment indicate that the proposed approach is able to converge to the optimal Pareto solutions. ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: IEEE open journal of the Communications Society
سال: 2021
ISSN: ['2644-125X']
DOI: https://doi.org/10.1109/ojcoms.2021.3092690